Greedy Strategies for Convex Optimization
نویسندگان
چکیده
We investigate two greedy strategies for finding an approximation to the minimum of a convex function E defined on a Hilbert space H. We prove convergence rates for these algorithms under suitable conditions on the objective function E. These conditions involve the behavior of the modulus of smoothness and the modulus of uniform convexity of E.
منابع مشابه
Sparse Signal Recovery via ECME Thresholding Pursuits
The emerging theory of compressive sensing CS provides a new sparse signal processing paradigm for reconstructing sparse signals from the undersampled linear measurements. Recently, numerous algorithms have been developed to solve convex optimization problems for CS sparse signal recovery. However, in some certain circumstances, greedy algorithms exhibit superior performance than convex methods...
متن کاملGreedy Alternating Optimization for FHIM
This report investigates and examines the greedy alternating optimization procedures used for solving the non-convex optimization problem of our Factorized High order Interactions Model (FHIM) model.
متن کاملGreedy expansions in convex optimization
This paper is a follow up to the previous author’s paper on convex optimization. In that paper we began the process of adjusting greedytype algorithms from nonlinear approximation for finding sparse solutions of convex optimization problems. We modified there three the most popular in nonlinear approximation in Banach spaces greedy algorithms – Weak Chebyshev Greedy Algorithm, Weak Greedy Algor...
متن کاملScaling Algorithms for M - convex Function Minimization
M-convex functions have various desirable properties as convexity in discrete optimization. We can find a global minimum of an M-convex function by a greedy algorithm, i.e., so-called descent algorithms work for the minimization. In this paper, we apply a scaling technique to a greedy algorithm and propose an efficient algorithm for the minimization of an M-convex function. Computational result...
متن کاملL1-regularization path algorithm for generalized linear models
We introduce a path following algorithm for L1-regularized generalized linear models. The L1-regularization procedure is useful especially because it, in effect, selects variables according to the amount of penalization on the L1-norm of the coefficients, in a manner that is less greedy than forward selection–backward deletion. The generalized linear model path algorithm efficiently computes so...
متن کامل